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ABSTRACT 

Developed to provide Washington State educators with 
information on the evaluation of computer software or courseware, 
this booklet includes brief sections on general criteria for 
evaluating instructional materials, general criteria for evaluating 
courseware, and special considerations in evaluating courseware. Such 
considerations include deciding whether computer software is 
appropr i ate ; specific criteria for different types of programs such 
as drill and practice, tutorials, or simulation; previewing; 
pre-purchase decisions; and finding others* courseware evaluations. A 
criteria and rating scale synthesized from a variety of sources is 
presented for use in checking software against some general criteria 
in the areas of content, presentation, interaction, and teacher use. 
Appendices contain laws and regulations governing instructional 
materials; criteria for the selection of instructional materials 
endorsed by the Washington State Board of Education (December 6, 
1974 ): 6 sample evaluation fo**ms; and source iniormation for 6 review 
journals and 21 periodical resources in computer educat i on . ( LMM ) 
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INTRODUCTION 



It is the puipose of this booklet to provide Wt^shington educators wi^h 
informalion on the evaluation of computer software or courseware • Many of 
the items included in this booklet have been printed elsewhere but are 

eofvipilod her(^ for your ease of use, 

Ttiis booklet includes sections on general criteria for evaluating instruc- 
tional materials, ge'ieral criteria for evalu^iting courseware, and special 
considerations in evaluating courseware. 
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(.JFNKKAL {^RHHRIA FOR EVALUATINC] INSTRUCTIONAL MATERIALS 



All instructional media and materials used in schools, both print and non- 
print, arc subject to the same content standards, including: 

Relevance to the curriculum . 

Appropriate reading level/level of difficulty. 

Freedom from stereotypes or demeaning biases. 

Standards for th^.* evaluation of computer software/courseware are no 
exception to these well established criteria. Likewise, the rules 
requiring a district instructional materials selection policy rmd adherence 
to that policy must include the selection of computer media within their 
scope, just as they include textbooks, films and the full range of other 
instructional media. 

Thest* customary standards and policy requirements are covered in two 
previously published SPI booklets, Handbook I: Guidelines for the De^ elop- 
ment of Instructional Materials Selection Policies and Handbook 11: Text- 
book Selection Criteria. It is therefore not within the scope of this 
handbook to review that material. For the reader^s convenience, however, 
ospeciaily relevant fxcerpts from these handbooks are included in the 
Appendix to this publication: 

From Handbook I: 

RC^W 28A. 58,103 Instructional Materials 
Criteria for Selection of Instructional Materials Endorsed 
by the State Board of Education 

From Handbook II: 

Procedures and Ceneric Evaluation Criteria 
Analyzing Readability 

Stuciy of Xhv entire (v.ntef)ts of Handbooks I and II is highly recommended- 
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CJKNKKAL (CRITERIA FOR EVALUATING COURSEWARK 



All software should be evaluated to assurp that the progrr.ms logienily 
relate to the curriculum of the school. The following criteria and rating 
scale for software evaluation is a synthesis from a variety of sources, 
incorporating the most commonly found criteria currently used in 
evaluations . 

The checklist will help the evaluatop check software ajrainst some general 
criteria in the area of content, presentation, interaction and teacher use. 
After this general evaluation, it is intended that the user will evaluate 
specific materials more critically in terms of the particular type of 
courseware involved (drill and practice, tutorial, simulation, game, 
information retrieval). The rating scale was purposely limited to four 
choices (excellent, good, adequate, poor) to avoid an "average" rating. 

Appendix III contains samples of other courseware e\ 'iiuation forms. 
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SOFTWARH KVAIA^ATION FORM 



(A SYNl'ill'.SIS OF C^OMMON (^HITKRIA FROM MANY SOUH(^FS) 



PA( KAdK ITFLK 
(IRAHF' FF:VFL 



SUHJFC^T AHKA 



rUHHKnn.UM ROLK: CHOUPlNfl: 

^Fiasic Individual 

,^u[>pIeniontary Small group 

Management system 

Other * 



Large group 



AUDIENCE: 

Remedial 

Gifted 

Special Needs 

Other 



PROCiRAM MODK: 

Drill and practice 

Tutorial 

Sirnulation 

Game 

^ Informational 

Problem solving 

Other 



OVERALL FVALUATION: 



Fxcel lent 



Good 



Adequate 



Not recommended 



I, PackH^^o aefuevos sp<MMfied rationale, goals, and 
objectives; co?)ipliN)iont s ongoing curriculum 

Learner competencies specified 

3. i-evei o\ uiffieulty appropriate for target audience 

4. Vtx'Hbul/iry used apf^ropriate for learner 

fj. Learner able to enter program at different levels 

PHl^Sf-N'rATlON 

. InstrucTIons ^nid presentation clear and logical 

7. Pre - inst ruct iona! stratCf^ies used {i.e., pre- 
t<\sts, afivanct^ organi/ers, title at beginning 

of un i ! ) 
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Graphics, color and sound used for appropriate 

instructional reasons (integrated into pro^^am, 
not distraction) 

9. Screen displays are clear 

10, Program flexibility accommodates both good and 
poor students 

IK Instructional strategies are interesting and 
motivating 

12. Materials are free of negative stereotyping 
INTERACTION 

13. Learner controls rate and sequence of presenta- 
tion and review 

14. Feedback on student responses effectively 
e?npIoyed 

15. Uses quick response and loading time 
15- Program is interactive 

!?• Program is easy to use and nonthreatening 
(uses a minimum of special codes , instruc- 
tions and symbols) 

TEACHER USE 

18. Program can be modified. 

19. Teacher^s manual provided (includes follow-up 
activities), 

20. Program includes record-keeping/reporting 
activities (if appropriate) 
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SPECIAL CONSIDERATIONS IN EVALUATING COURSEWARE 

A . When is computer software the best teaching tool? 

Teachers need to be able to judge whether microcomputer software 
(courseware) is or is not the appropriate technology for a specific 
learning situation. Before making a final decision about purchasing 
software, the teacher should ask, ''Can the lesson be taught just as 
efficiently and effectively (and less expensively) some other way?" If 
the answer i| "no", then the teacher needs to take steps to evaluate 
the software : 

1. If available, read the documentation that is provided for the 
software. 

2. Identify the instructional oL ctives that are purported to be 
covered by the software. Be sure they fit your curriculum. 

3- Run the program as if you were a motivated and/or successful 
student . 

4. Rlh the program again as if you were an unmotivated or 
unsuccessful student. Try both reasonable and unreasonable 
responses to determine if the program is user friendly. 

5. Complete an evaluation form in order to systematically collect 
data. 

6. Review the o/iginal objectives to ensure that program does 
indeed do what it is supposed to do. Consider alternative uses. 

7. Compare the program qualities with your needs. 

8. Make a decision regarding purchase. 

B. What s pecial criteria are there for different types of programs? 

In addition to criteria for evaluating all computer courseware, 
appropriate criteria should be used for the particular type of 
courseware — drill and practice, tutorial, problem-solving, gaming 
simulation or information retrieval. ' 



Adapted from handout, St. Martin's College, Lacey, WA 
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Following are criteria specific to each genre : 

1. Drill and Practice — provides practice for a skill taught 
previously. 

a* Is there a variety of levels of difficulty? 

b. Is additional practice p^^ovided as needed? 

c. Does the program provide management feedback—record student 
performance? 

d. Are positive and negative feedback given, as well as necessary 
hints? 

2. Tutorial ~ conducts actual instruction, generally in the form of 
a dialogue between the student and the computer. 

a. Is there an appropriate amount of interaction? 

b. Is evaluation included? 

c. Can appropriate segments be accessed by the student without 
going through the entire sequence? 

3. Simulation — generates models of environments, experiments, etc. 

a* Is there a reason for using a simulation rather than actual 
experience, for example, danger or expense? 

b. Are opportunities tc generalize provided? 

c» Is graphic representation utilized? 

d. Are any assumptions identified? 

e. Is the simulation based on a valid model? 

**Reprinted with permission from Minnesota Association for Supervision 
and Curriculum Development, The Use of a Computer to Help Teach the School 
Curriculum , 1982. 
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4. Game generelly includes randomized events, provides an 
opportunity to "win," and presents some obstacles to "winning." 

a. Is the game appropriate to your needs or objectives? 

b. is it instructional as well as diverting? 

c. Is the student motivated toward learning rather than just 
winning? 

5. Information Retrieval — information (data) is generated in the 
form of lists, graphj, tables, etc. 

a. Is documentation easy to understand? 

b. Is storage capacity adequate? 

c. Is speed of operation or access adequate? 
How can courseware be previewed? 

Previewing courseware is often a problem. Teachers should find out 
early what the opportunities are for previewing courseware in which 
they are interested. Vendors and producers have different preview 
policies. Some companies offer 30-day preview, but care should be 
taken to assure that this does not mean "preview" of a sample disk, 
which is rarely sufficient for evaluating the program or its utility 
in the classroom. Some vendors will obtain preview programs for you 
and allow you to do the previewing at their place of business. 

Note: The amount of time teachers take to preview materials should be 
aetermined in part by the relative importance of the material in the 
curriculum. It is less important to give a thorough evaluation to a 
short, inexpensive program which will be used to supplement basic 
materials than it is to give close attention to all aspects of 
materials which will be used as basic materials for instruction. 
(Considerations of accurate, non-biased content and appropriate grade 
level, as well as simply whether the program will run, are always 
important, of course.) 
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Where can others^ evaluations of courseware be found? 



Many sources of reviews of software are available today. Refer to the 
Appendix for a listing of the ^^st commonly available sources. Note 
that one of these is a computeru^^d database of courseware evaluations, 
RICE, Details about RICE and how to access it are also given in the 
Appendix • 

Are there other decisions to make before purchase? 

A decision which should be made before purchase is whether or not back- 
up (duplicate) copies may be made as a condition of purchase, in case 
of damage to disks or loss of program by improper use. Many producers 
offer this feature as part of the purchase, with guarantees provided by 
the purchaser regarding the number of back-up copies to be made. 



Appen€!ix I 
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I. LAWS AND REGULATIONS GOVEf'NING INSTRUCTIONAL MATERIALS 



THE LEGAL BASIS FOf. SELECTION OF INSTRUCTIONAL MATERIALS 

IN WASHINGTON 



RCW 28A.58.103 INSTRUCTIONAL MATERL\LS INSTRUCTIONAL MATERIALS 

COMMITTEE. Every board of directors, unless otherwise specifically 
provided by law, shall: 

(1) Prepare, negotiate, set forth in writing and adopt, polic" relative to 
the selection of instructional materials. Such policy shall: 

(a) State the school district's goals and principles relative lo 
instructional materials; 

(b) Delegate responsibility for the preparation and recommendation of 
teachers' reading lists and specify the procedures to be followed 
in the selection of all instructional materials including text 
books; 

(c) Establish an instructional materials committee to be appointed, 
with the approval of the school board, by the school district's 
chief administrative officer. This committee shall consist of 
representative members of the district's professional staff, 
including representation from the district's curriculum develop- 
ment committees, and, in the case of districts which operate 
elementary school(s) only, the educational service district 
superintendent, one of whose responsibilities shall be to assure 
the correlation of those elementary district adoptions with those 
of the high school district(s) which serve their children; 

(d) Provide for terms of office for members of the instructional 
materials committee; 

(c) Provide a system for receiving, considering and acting upon 
written complaints regarding instructional materials used by the 
school district; 

(f) Provide free text books, supplies and other instructional 
materials to be loaned to the pupils of the school, when, in its 
judgment, the best interests of the district will be served 
thereby and prescribe rules and regulations to preserve such 
books, supplies and other instructional materials from 
unnecessary damage. 



Recommendation of instructionfll materials s^iall be by thr 
district's instructional materiaLs conunittcr in ^iccorci^nico witfi 
district policy . Approval shall be by tfir locvil scboo 1 
district's board of direclo/*^ 
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II. CRITI-RIA FOR Sl-LECTION OF INSTRUCTIONAL MATERIALS 

KNi)ORSf-L) BY THK STATE BOARD OF EDUCATION - DECEMBER 6, 1974 



TJ'.o oornorst one of ioHrr.ing resources programs should be a written 
selection policy that gives both shape and direction to the development of 
that program as an integral part of the instructional process. 

In compliance with RCW 28A.58 .103, requiring districts to "prepare, 
negotiate, set forth in writing and adopt policy relative to the selection 
of instructional materials," such policies and procedures shall reflect, 
hut not be limited to, the following concerns: 

(1) Instructional materials shall enrich and support the curriculum, 
taking into consideration the varied instructional needs, abili- 
ties, interests, and maturity levels of the students served. 

(2) Instructional materials shall stimulate student growth in 
conceptual thinking, factual knowledge, physical fitness, 
literary appreciation, aesthetic values, and the development of 
ethical standards. 

(3) Instructional materials shall be of sufficient variety so as to 
present opposing views of controversial is?ues in order that 
youn^ citizens may develop the skills of critical analysis and 
informed decision making. 

(4) Instructional materials hereafter developed or purchased shall 
contribute to the development of an understanding of the ethnic, 
cultural, and occupational diversity of American life. 

(a) Instructional materials shall objectively present tf^e 
concerns and build upon the contributions, current and 
historical, of both sexes, and members of the several 
specific religious , ethnic and cuUural groups. School 
districts should recognize, however, that under certain 
conditions, biased materials may represent appropriate 
resources in presenting contrasting and differing points of 
view . 

(b) histructional materials shall provide models which may be 
used as a vehicle for the development of self-respect, 
ethnic pride and appreciation of cultural differences, based 
on respect for the worth, dignity, and personal values of 
every individual. 



Instructional materials in.-Iuding textl>ooks ( siri^^h^ or [luil t i - 
pie) , programmed learning, teleoourscs, pHcknf^rd co\iv<c^ or 
units , filmed courses , and the like nrc j^enprn 11 y t \)v 
re^iources for teaching and learning. Therefore, mI! of t))v nbov^^ 
criteria should be adhered to in their selection. 



PHOCKi)URRS AND OKNEHIC EVALUATION CRITERIA 



PHI'I.IMINARY AC'I IViTlI-S; 

1. OoHlo mntorials selection committee. 

2. KstHblish statement of selection procedures. 

3. Determine who wiii make the final decision. 

4. Hstablish titno lines, 

r>. Arrange for background information on trends. 

a. "Trend" articles in professional joui.ials. 

b. Reviews in professional journals . 

c. CTonsultant help (state, university, etc.) 

t>. Wr ite consensus statements on broad prograrn go^ils. 

a. What is the underlying philosophy of the program? 

b. Can p-ogram emphasis be clearly identified? 

c. What should the program do for the student? 

d. Can expected skills, behaviors, or attitudes be identified? 

7. Take an inventory of the local situation. 

a. Teaching staff -strengths or weaknesses in terms of training, 
background, experiences or special abilities. 

b. Equipment , materials, ana facilities as presently available, 
and how they might affect the program. 

c. Administrative attitudes and budget commitment. 

d. Any district factors that could have an effect on the 
program . 

e. Har-kground, abilities, attitudes and interests of the 
student population. 

8. Arrange for securing materials samples. 

a. Contact Washington -Alaska Textbook Representatives' 
Association . 

b. Use list of companies in the Washington Education 
! ) i re cto ry . 

c. r^all the state supervisor (i.e., language, mathematics, 
science, foreign language). 

«i. Attend exhibits, contact vendors. 

9. Request names from publishers of districts already using 
materials for dialog or visitation?. 
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EXAMINATION PROCHnURH: 



1. Distribute and discuss accornpanyiTig criteria shcrl for s^x^cific 
content area, 

a. Revise , if necessary* 

b . Add other categories, if necessary . 

2. Assign categories for in-depth (examination of niat(erials. 

a. Work singly or in pairs, dependin^^ on si/e of j^rouf). 

b. Work in any number of categories. 

3. Check each materials set against the criteria. 

a. Each person checks a_n materials for one catogory at a t;ine. 
Exampl e: Each person checks [)resenta t ion t>f cultural 
material in four samples. 

4. If a weighted scale is desired , assign a weight to each criterion 
according to the local priorities. 

5. Assign a rating to each category of each set of fnatf^'ials, 
(Depending on size of committee, decide whelhcM' this shouU) be 
done singly, in pairs, in groups, etc.). 

a. Use the following rating scale: 

4 Excellent; 3 - Acceptable; 2 - Poor; 1 Unacceptat>1o; 
0 = Not Applicable. 

b. Accompany each rating with a brief explanation ^'[ivitig 
reasons for the rating of any {)articular catc^gory. 

e. Use readability rating scah^s sucfi as I'ry. 

6. Summarize the ratings, one at a time. 

a. Each category used must be rated. 

b. Total all the rating^:* 

7. Hink materials according to total ratings. 

8. Select by consensus from among top choices. 

a. Discussion is necessary at this point. 

b. Top choices must be adjusted in terms of local realities. 

c. See A. 6. of this section for suggestions. 



j 



r. 




the uso of the new materials. 

1. Proserviee, 

a. Identify services provided by publishers. 

b. Piap preservice before implementation. 

2. Inscrvice. 



Plan periodic i.iservice during the first year. 
Plan for inservice for new personnel. 
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GENERIC EVALUATION CRITERIA FOR BASIC MATHlUAf.S 



PUBLISHERS AND AUTHOR/S 

o Does the publisher have a good reputation for publishing in tho 
subject area under consideration? 

o Are the major authors recognized and acknowledged authorities in 
the field? 

o Do the supporting authors have sufficient expertise in the field? 

o Is there evidence that the major authors have indeed supervised and 
coordinated the construction of the text rather than just loni 
their names to the effort? 

OBJECTIVES 

o Are the objectives easy to identify and clearly written? 

o On what are the objectives based? Take into consideration such 
things as research , empirical evidence, experience , Icnrnin^ 
theory, and so forth. 

o Will the objectives meet the needs or goals of your particular 
students and community? 

o Are the objectives workable, understandable, and useful to the 
classroom teacher? 

o Are the objectives realistic from the standpoint of what can be 
expected from your program? 

CONTENT 

o From the standpoint of child de veloom en t , is the material 
appropriate, relevant, and interesting? 

o Does the text deal effectively with minority f^roups both in text 
and in illustrations? 

o Taking into consideration that young children tend to believe what 
they read, is the content accurate, responsible, and realistic? 



ORGANIZATION/SCOPE AND SEQUENCE 

o What was the basis used for the organization of the materials? 

o Are the basic content and skills of the program available in a 
practical chart or outline form? 

o Can the skills listed actually be taught using the content? 

o Will the skills listed satisfy the objectives of the schoors 
program as well as the community's priorities? 

o Are^ the skills listed in the scope and sequence actually taught on 
the pages and in the sections they purport to be? 

TEACHING AND LEARNING STRATEGIES 

o Is there a suggested teaching approach? 

o Does the method require extensive preparation and training on the 
part of the teacher? 

o Is there any experimental evidence to indicate that the method is 
especially effective? 

o Are there learning strategies to accommodate the corrective and/or 
remedial? 

o Are there appropriate strategies to enable a new student to 
transfer comfortably into the program? 

o In tracing the teaching of any given skill through the series, will 
the amount and spacing of the teaching result in the behavior 
desired? 

o Is each skill presented in successively more difficult degrees and 
with sufficient variation? 

o Are readiness skills presented throughout the series? 

o Can the program be used in a variety of classroom organizational 
patterns? 



EVALUATION PROCEDURES 

o Are there appropriate methods of evaluating stucient placement in or 
exit from any given level? 

o Is there some form of informal and formal (standardized) testing to 
estimate a student^s overall progress or to determine specific 
areas of reading strength and deficiency? 

o Does the publisher give information about the de jlopn^ent, 
standardization, and interpretation of the formal testing program? 

o Are the tests easy to administer, score, and interpret? 

o Is the record keeping system simple, understandable, and efficient? 

COMPONENT PARTS 

o Is there a teacher^s manual for each level that provides a general 
overview of the entire program? 

o Are the teacher's manuals programmed in such a way that all 
teachers can follow with a minimum of orientation? 

o Are there functional applications to extend and enrich the program? 

o Are the readability and task requirements of the program and/or 
supplementary material at the independent reading level of the 
student? 

0 Do the teaching aids enhance the program in an interesting and 
practical manner? 

o Does the usefulness of the teaching aids warrant their cost? 

o Are the supplementary materials a critical part of th^ program? 

PIIYSICAL CHARACTERISTICS 

0 Are the aesthetics appropriate for the intended age level? 

0 Is the size and type of print appropriate for the level of learner 
intended? 
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o Do the visuals stimulate creative thinking, concept development 
and language growth? 

o Is the durability appropriate for the intended use of the material? 
TOTAL COST 

o When comparing two programs does the predicted learning outcom 
justify the cost per pupil? 
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ANALYZING READABILITY 



WARNING; Many factors influence readability. Readability formulas 
are estimates of readability and should not be interpreted 
as the readability or difficulty level of the text. They 
are better than nothing but tend to measure sentence and 
word length and in some cases "uncommon words." They do not 
measure "concept load," "format," "unusual syntax," "complex 
short vocabulary," or "unusual style." These factors must 
be measured by other means. Materials must not be selected 
or rejected on the basis of readability only. 

Students will not benefit from even the best-iesigned curriculum materials 
unless they can read them. Thus reading level is an important factor in 
determining whether materials are appropriate for the grade levels at which 
they will be introduced. 

The checklist on the following pages provides a comprehensive analysis of 
readability. If it is used conscientiously, a thorough analysis of 
material will be made providing for better adoption decisions. It should 
be noted that the use of a formula is only one item (I - N) on the 
checklist . 

The Fry Readability Formula, which is attached, is ou of the most commonly 
and widely used inptruments in measuring readability. (Other instruments 
include SMOG, NEW HAMPSHIRE, LORGE, SPACHE, DALE-CHAI.L. CLOZE procedures, 
and others). 

For other factors to consider in matching text to population needs, see How 
t o Select Elementary Reading Programs, by Dr. Ruth Waugh, University of 
"Oregon, January 11, 1979, (Northwest Reading Consortia), which contains 
materials on matching materials to population needs. 



Readability Checklist 



This checklist is designed to help you evaluate the readability of your 
classroom materials. It can best be used while you are thinking of a 
specific class. Be sure to compare the material to a fictional ideal 
rather than to other materials. Finally, consider supplementary materials 
as part of the basic material for this purpose, and rate them together. 
Have fun! 
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Hatti the questions below using the following rating system: 



5 - Excellent 
4 - Good 
3 - Adequate 
2 - Poor 

1 - Unacceptable 
NA - Not applicable 



Further comments may be written in the space provided. 
Title: 



Publisher: 

Copyright dates 



Understandability 

A. Are the assumptions about students^ vocabulary knowledge 

appropriate? 

B. Are the assumptions about students* prior knowledge of 

this content area appropriate? 

Are the assumptions about students^ general experiential 

backgrounds appropriate? 

Does the teacher^s manual provide the teacher with ways 

to develop and review the students^ conceptual and 
experiential backgrounds? 

E. Are new concepts explicitly linked to the students^ prior 

knowledge or to their experiential backgrounds? 

Does the material introduce abstract concepts by 

accompanying them with many concrete examples? 

G. Does the material introduce new concepts one at a time 

with a sufficient number of examples for each one? 

H. Are definitions understandable and at a lower level of 

abstraction than the concept being defined? 

K Is the level of sentence complexity appropriate for the 

students? 
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J. Are the main ideas clearly stated? 

K. Are irrelevant details avoided? 



L. Are important complex relationships expHcitly stated 

(e.g. , causality, conditionality , etc. ) rather than 
expecting the reader to infer them from the context? 

M. Does the teacher^s manual provide lists of accessible 

resources containing alternative readings for the very 
poor or very advanced readers? 

N . Is the readability level appropriate (according to a 

readability formula)? (Fry Formula attached) 

Learnability 
(Organization) 

A. Is an introduction provided in each section? 



B. Is there a clear and simple organizational pattern 

relating the sections to each other? 

C. Does each section have a clear, explicit, and simple 

organizational structure? 

D. Does the text include resources such as an index, 

glossary, and table of contents (or menu)? 

E. Do questions and activities draw attention to the 

organizational pattern of the material (c.^., 
chronological, cause and effect, spatial, topical, etc?) 

F. Do consumable materials interrelate well with the basic 

material? 

G. Is the vocabulary appropriately sequenced from simple to 
more complex? 

H. Are definitions for vocabulary appropriately placed 

(close to the word or in glossary)? 
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(Reinforcement) 

^' i^oes the material provide opportunities for students to 

practice using new concepts? 

^« Are there summaries at appropriate intervals? 

^* Are adequ'ate iconic aids such as maps, graphs, 

illustrations, etc. provided to reinforce concepts? 

Are the iconic aids appropriately placed near the textual 

reference (or provided for easy reference)? 

^- Are there adequate suggestions for usable supplementary 

activities? 

^- these activities provide for a broad range of ability 

levels? 

Are there literal recall questions provided for the 

students' self review? 

^' Do some of the questions encourage the students to draw 

inferences? 

^* Are there discussion questions which encourage creative 

thinking? 

J- Are questions clearly worded? 

(Motivation ) 

A- i^oes the teacher's manual provide introductory activities 

that will capture students' interest? 

Are titles and subheadings concrete, meaningful, or 

interesting? 

the writing style appealing to the students? 

^- Are the activities motivating? Will they make the 

student want to pursue the topic further? 

^- the material clearly show how the knowledge being 

learned might be used by the learner in the future? 
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F. Is the format appealing to the students? 

G. Are positive and motivating models provided for t>oth 

sexes as well as for other racial,^ ethnic and socio- 
economic groups? 



III. Readability Analysis 
(Weaknesses) 

1) On which items was the lowest rating given? 

2) Did these items tend to fall in certain categories? 

3) Summarize the weaknesses of this material. 

4) What can you do in class to compensate for weaknesses? 

(Assets) 



1) Which items were rated the highest? 

2) Did these items fall in certain categories? 

3) Summarize the assets of this material. 

4) What can you do in class to take advantage of the assets of this 
material? 



Source: "Assessing Readability: The Checklist Approach" by Judith 
Westphai Irwin and Carol A. Davis, Purdue University, Journal of 
Reading. November, 1980. 
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FRV .^.u OAH ::.:tv >;s.\?m 

r.Jward Frv Rut«or» L'niver«Uv 




3) 



DiricrioM for utiag tht r««(i«bility graphs 

1) S«l.ct thr.. 100 word p....t.. fro. „„r :h. b.sinnin,, siddU, *nd 
•nd of th« book. Skip ill proptr nouni. 

2) Count th« coc*l nuabar of sincancs* in iich 100 word p«fs«g« 
(titisnting to th« n.arift ttnth of « ttnt«r,rt). Aver.g. th.i. thre* 
nuvbars. 

Count ch« tot«l nuabtr of lylUblt. in itch 100 word f«apl«. There 
ii * iylliblt for .ich vow«l «ound; for txuplc: c«t (1), bl.ckbird 
(2), contin-neil {(,). Don't ba fooltd by word aiz.; for ex«ple- 
polio (3), through (i^ Endin«i lucfa «i -y, -,d, or -1« uiu-ily 
Mkt < lyU.bltj for .xt-pUi rwdy (2). Av.r.gt tht tot-1 n«.b.r 
*yll«blaf for the thrM tMpIas. 

Plot on tht graph tht avtragt nuab.r of stnttncta pe- 100 word. *nd 
tht «vtr«ga nuabar of »ylUblt« par 100 wordi. Moic plot points ftij 
nt.r tha haavy curvad lint. Ptrpandicul.r Up,, ..rk off ipnroxi- 
grada laval crtai. -'^ 

An aitarnat.tfa practica ii to indic/-ta tha ranga of rtadability by 
plotting tha acorai on varioui p«taagai rathtr than «vtrtging tha 
rtiuitf of thrta aaltctiont. 



4) 



5) 
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FRY READABIUTY GRAPH 
Report Sheet 

Name of reviewer Course Sec. 

Material: Book, magazine, etc., including title, author, copyright date 



Page(s) Sentences Syllables Level 

Sample #1 

Sample #2 

Sample #3 



AVERAGE 



Remarks about findings; 



o 

ERIC 
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^tft courseware description 



NORTHWEST REGIONAL 
EDUC A TION AL LABOR ATOR Y 



set/ Topics 



Grad« w*v«H«netrci«J pr*.l 1 2 3 4 $ e 7 I f 10 t1 T2 poai-MOOrt4arv 



i«cfc Up i^oucv - ^ _ ■ 

field t«B( 4m )• WMIVM* Donravi^tt Gw<VipM«i« Gn^ 



pi— mm cH«ck fftl «pp{tc«M« 



mmnm%mmmM 

G Authofinfi 
Gorilt and prBCttcs 



Qommm 

Ctitmulmiion 



OOClMHaNTATIOft AVAILAtLE 

^ t pf09r«i« output 

^ 1 Program «p«fatJnf mvcructioni 



^ S ^•♦Xjrc*/ rmimrmrtcm iMormmHot% 
^ t Qxhmf 



pmckm9% QONTtSl ANO iTKJCTruU, inGii4tf4n« rmcor^ kt^tnfi mtf r^»orC(nfi Viht-.f^k*. 



ERIC 
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COURSEWARE EVALUATION 



NOItTHWtST REGIONAL 
EDUCATIONAL Lj^dORATORY 



0«u 



Organiiacton 



O Ch«Q^ th4« bax If •v«iu«<iOn >• t)«#«a (Mv^W on your obMrwMion of l&idwit u«« of this paclvage 



CQWTINT CHAJUCTMrncS 



(11 


SA 


A 


0 


SO 


NA 




(2) 


SA 


A 


0 


SO 


I^CA 






SA 


A 


D 


so 


HA 


Xhm ooncvni frwm of tmcm, *■ tytnc* im and otfivr «Mf«(itvp««. 


NsmucTiofiAL cNARAcrmmcf 




lA 


A 


D 


SO 


HA 


Th« pwtyw «< m« »a0ki|o it wmU 


i«) 


SA 


A 


0 


so 


HA 




(«} 


1/. 


A 


D 


so 


HA 




(T) 


ftA 


A 


D 


so 


HA 


Thm ^ ^fHouSty t« jppFiprif for tfw tftrvot ««fdt«n««. 


(i) 


SA 


A 


D 


so 


HA 


OfipMOA'odtor/'Muntf m uo«rf tar ag^t^t&tm mmtciion^ rMtemt 


(il 


lA 


A 


0 


so 


HA 


Um of tft« pBft.if< i» motiv««lan^l. 




SA 


A 


0 


SO 


HA 


T>i« offactiv^fv •fmulalM viurfsnt GfM(tvti>. 




SA 


A 


0 


so 


HA 




{12) 


SA 


A 


0 


so 


HA 




{13) 


SA 


A 


D 


so 


HA 


tnMuctlen i« intt^ f< w4tt« pr»viou« ttucSAit ti^tftvnG*. 


{14* 


SA 


A 


D 


so 


HA 


T ■fculmp OCR b« 9«naralisad to on a^pioprfm rvgo of tiCMSfions. 



TKNuttcAL cHARAcnmsncs 



{ii) 


SA 


A 


D 


SO 


NA 


Thm MOT ■M»gft mM«ha;« mrm taampewhmnmtym. 




SA 


A 


D 


so 


HA 




117] 


SA 


A 


0 


so 


HA 


info#!n«tiOn Clifl||{oir« or* vrfoetiv*^ 


tim 


SA 


A 


0 


so 


HA 


Intandorf u»fi can oAo^ty mnd indviondontiy oporot* tH« pro-am. 


{ifi 


SA 


A 


D 


so 


HA 


Taaoffar« can aattiiv anvlov tf^ p^csttaga. 




SA 


A 


0 


so 


HA 


Tha pro pram ^p|N«fr^a(a<v u— rafavant oomputv capaMUtiat. 


{21) 


SA 


A 


0 


so 


HA 


1>va piafrpw ra<{Mi<a in normal 



QuAury 

J^Fftta • mim^ from 1 How) 
to S ihiQhi w^icft raptaaanti 
vour jiKfgamanf of m« oaatity 
of ma pac«<ao« m vacti 

dtvioion: 



Contant 

, CharBct«fiBifC9 
*acf>nicat 
Charactwianoa 



KCCQMMEN0AT1ONS 



1 hi^fy r 



( i««ui<S uaa or 
uaa of trtii pactiaga «Mtfi 
}in!a Of no ^Yanga. (Noia 
•LiM^^io*^ fof afVactiva 
uaa baiow.i 

i wDufd uaa or raooinmano 
Moa 9( tMfl pac^apa on^v <t 
carta^n c^angaa ««<ara ^ada, 
{No<« cftanfaa undar y^mm* 
fymmrn^ or offtar c gn ^no ' ^t^,.' 

i nKXjid not uaa or racon^ 
mand r pac^aga. (^^ota 



0«Mi*a lha petantiat u*a of tf^a paokata m etaaaroom aaettn«« 



taumata tha amatnt of ttma a ftudant vuouid naad fio Mork 

w^iTt lha pac^ava tn ordar co achi«va the o^jactivaa: 

{Can ^ ttKal tima, tinia par d«y, tima ran^a or omar ind^oaGor.) 
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Othcf comments: 
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PERSONAL EVALUATION CRJTSRiA 
FOR EDUCATIONAL MATERIAI^ 



Kune: 



Imtnietiomt 



On this sheet list ffSMrel ehartcteriitia or feetures th«t you desire in 
eduettiontl m«teri«ls (books, films, eduestionsl jptmes, etc.). 



M£CC 



REPRINTED V'lTH PERMISSION OF THE MINNESOTA EDUCATIONAL COMPUTING 

CONSORTIUM 

ERIC i}i 



SAMPLE LIST OF GENERAL EVALUATION FACTORS FOR EDUCATIQNAt, KATERIALS 

ACCURATE SUBJECT HATTER 

APPROPRIATE READING LEVtl 

APPROPRIATE LENGTH OF ACTIVITY 

CLEAR. CONCISE INSTRUCTIONS 

LOGICAL SEQUENCE OF ACTIVITY 

ATTRACTIVE LAYOUT AND PRESENTATION 

CORRECT GRAHKAR USED 

MOTIVATIONAL 

SOCIALLY ACCEPTABLE 

(CONSIDER STEREOTYPES, REFERE!«:ES TO VIOLENCE. ETC.) 

COMPLETE TEACHER SUPPORT MATERIALS 

(LESSON SUGGESTIONS, WORKSHEETS, ANSWER KEYS, ETC.) 

COST 



■MECC 



ADDITIONAL FVA! llAHnw (;|^npp|/^ 
FOR CtMPUTER-RASFn RlHTATTn UAL rnURfyirfflaF 

USES COMPUTER CAPABILITIES APPROPRIATaV 
INTERACTIVE 
RANDWI EVENTS 
GRAPHICS S ANIMATION 
SOUND 

USER CONTROLS PROGRAM 

MOVEMENT BETWEEN SCREENS 
PROGRAM OPTIONS 

EASY 'FOOLPROOF- INPUT 
CLEAR OPTIONS 
AVOIDS EXCESSIVE TAPING 
HANDLES UNUSUAL INPUTS VELl 

EFFECTIVE AND APPROPRIATE REINFORCEMENT 
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COMPUTER SOFTWARE SELECTION CHECKLIST 



A. CONTENT — Th« s«m« coniidvratkms tppfy ■« for othor ir^ructionai modia 
Ovtriii: 

1. It th« ccmxmM »ppropri«tt to your notdt? 

2- DoM It luppoft your curriculum objtotivot? 

8. INSTHUCTIONAL OitlQN - Numtroui typot progrsmt art avaliabta. Tho 
following «ro common oxtmplot snd tomo of tt>o oonoorm ^ 



K*sponM 



1. 



Or« and ^raoliGo - pr ovkioa practioa for a m\ pr«v«o(M(y. 

a. It mart a vafi#ly of (avtts of dtTfteulty? 

b. is additional pfMico provldad aa nwdad? 



OOM tha program provldo man«oam«nt faadback— raoord ^udant p«rfor- 
manca? 



d. Ara poaltiva and nagatWa faadb«ck ghw, aa wall aa any naraatarjf hints? 

Tutorial — conducta actual InatructJon, 9«narm^ In tha form of a diatogua bat- 
waan tha studant and th« compu^. 



Yaa 
Yaa 

Yac 
Yaa 



Ho 
NO 



No 
NO 

No 
No 



a. (a thara an appropria^ anwint of Intaraction? 


"aa 


No 


b. It avaiuat^on indudad? 


Yaa 


No 


c. Can appropfiattt aaomanta ba aooaaaad by ttvi ttudant wtthout going 
tfirough tha antra aaQuaf>oa? 


Yaa 


No 


timuiatioii — ganarataa modM of afivtronn^aott, axparimanta, ate. 






a. li thara i raaaon iof ua<ng a timulatJon rath»r than actual axparlonoa. for 
axampla. dangar or ^%p^nml 


Yaa 


No 


b. Ara opportunttiaa to fi^naraUza provided? 


Yaa 


No 


c. It graphs rapraaantat^ utIUxad? 


Yaa 


No 


d. Ara any ataumpttona Idandftad? 


Yaa 


No 


a. it tha timuiaiion baaad on a vaUd modal? 


Yaa 


No 


Oama — ganaraUy inoJudaa randomlxad avan^ providaa an o^portiH^ to 
"win." and praaantt acma obatadaa to ''winnlno.'* 






a. it tha gama ipproprlata to your naada or objactNaa? 


Yaa 


No 


b. (a it inttructional at waii aa divarting? 


Yaa 


No 


c. It tha ttudant motivatad toward kiaming rattiar than juat winning? 


Yaa 


No 
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REPRINTED UITH PERfllSSION OF THE MINNESOTA CURRICULUM SERVICES CENTER 



Information fl«tri«vftl — informttlon (dau) is g«n«r«t«cl in !h« form of lists, 
graphs* tabl«t^ stc. 



a. is documanution aasy to undtfitand? Yea No 

b. la storaga capacity adaquata? y^g t4o 

c. is spaad of i^Taration or accaaa adaquata? vas No 

6. UtJIKy — a support program for ttia taacnar to ganarata »tudant actwmaa, a g.. 
crossword puzzlaa, word gamaa* indlvidu^lwJ sparling or mstti driiis, ate 

a. ts ma utiiity program fiaxibia? Yaa No 

b. Is It aasy to uaa? Yaa No 

c. U it waii documantad? Yaa No 

7. ManataiMflt — rmcor^ kaapln^ of studant parformsnca, which may ba an in- 
tagral part of anothar program or uaad alor>a aa a sourca of dtagn(»)s snd 
pfaacdp^. 

a. Is It aasy to uaa? Y»g 

b. ia format auitabia for raporting? Yaa No 

c. Doaa It kiaura atudant privacy? Vm no 

(N.b. Combinations of tha typw of progrsms llstad abova sra common, so it may b« 
difficult to lab«i soma programs as to spacific ty pa.) 

8. Is tha program fraa of raclaJ/aaxuai, soctsi starac-typas, (nspproprista 
languaga* ate? ym ho 

FHiSCNTATION 

1. Fiirpoaa — Is ttia fntandad uaa — initiai Instruction, ramadiatlon, gutdad prac- 

tica, indapandant practica Of anrichmant/'jxt^sion^«vidant? yss nc 

2. Dlractiofia — Ara thay ciaar to ttia studants? Yas No 

3. Objactlvaa Doaa ma studant know wnat is to ba gslnad by usln^ ttia 
program? y.^ ^ 

4. Fa«€jtacfc — is it affactiva from ma studants' parspactiva? Yaa No 

a. Doaa ttia faadbaok vary with tha parformanca? y«# Nq 

b. Doaa tha learnar gat a corract anawar sfTar thraa or lass wrong sttampts? Yas No 

c. Doaa tha feedback (aad to additional teaming or marafy state Vight" or 

'•wrong'*? Yaa No 

5. Diaplay — Is tha program visually appaaling, sttractiva. raadabia? Yes No 

5. laae of uaa Can tha program be used indapendantty with a minimum of 

taecnar praparaion or i n iafva nik m? ym no 



7, Ui«r Control — Ooot tho studi ^p\% cm*"^ ovor r«to ot protofitation? Ym No 

m. Can tMo itu^t b«oin m« ht^iructlOT it ■ lovol approf»f{«tO to hte or )w 

Ability? Ym no 

0. Can tno AUidont MOic hotp from tno prc^ram? Ym No 

6. Tli«or«tie«l iMii — DoM tho inttruoti^ti^ (Men r«n«ct aound iMming 

tnoory? Vm mo 

9. Is tho ordM of proMnttlton logfoal and MquanteT? Ym No 

10. Hava any witkal prafMKNalla MKk^ bMn idantifM? Ym No 

a. ii it oiaar wfiat tha ^c^t muat know or ba at»la to do bafoca uaing ttia 

program? Ym No 

1 1 . f ntandad Appropriata AuilSafioa 

a. it is ciaar for wfKmv tha program waa daaignad? Ym No 

b. Is It daar for wtiom it is appropriata? Ym No 
TECHNICAL OfUCN 

1. la ttia program •'arror frM**? Ym No 

2. DoM tha program maka affaoviva, purpoaaful uaa of co^. graphioa and 

sound, or ara tnay usad just for **show^ Ym No 

3. OOM tf>a >>rogrsm adaquata(y provlda for miMpallad words, or variationa of 
rasponsM. Ym No 

SU^BT MATlHIALt 

1. Ara tha ob{actfvaa of tha support matartais ciMfiy daf^nad? Ym No 
r Do thay match/comptamant thoaa ol ma program? Ym No 

2. Is it avidant whsthar support matariais ara opHoftai or raqiHrad for propar uM 

of tha program? Ym No 

3. Do tha support matariais provida tha taachar with addWanal bael(«rei^* La*. 

a bibliography or othar raaourcM, sampla run of tha program, ale.? Ym ho 

4. Ara tha studant matarWa affactiva, attraettva. appaaMng, usaful, ale.? Ym No 

EQUI^MCNT — Havf tha following factora baan taKan into aooount and found ao- 
captabia or avsilabia; 



1. 


Appropriata computar? 


Ym 


MO 


2. 


Languaga? 


Ym 


No 


3. 


Mamory? 


Ym 


No 


4 


DisK or Tapa? 


Ym 


No 


5 


Spaciai aqulpmant such m a printar, light pan, paddlaa, loy stick, alo.? 


Ym 


NO 
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FVojfram Evaluation 

Salact a sccre from CK4 for each critericxi and write t±m 
soors in the right-hand cx^lum. A score of 4 irdicatei 
E^a^lSTTj 3 indixMte» GOCD; 2 Ir^iicateft SATISFACTORY j 
1 indicat«i CNSATISFACTORif, and 0 indicates NOT APPRCPRIA3E, 



are inportant to the curriculum. 



Qantent matchfes instructional objectives • 



Method used to taach ocntmt is effective. 



Instructional strategies interestir^ and 
notivating. 



fteading level is appropriate to target audience. 



l^ts are designed wsll« including a sufficient 
nu!t3«r of test itons to assess nmstery. 



Content is free of race^ ethnic, and sex sterotypM* 

Teacher support includes clear and detailed 
inforration on oontent, instructional objectives^ 
and technical use of progra;.. 



C'nlcritio 


■■ ■ 

Scar* 


Cfcntant is curriculupHsased, 


... 1 


Content is accurate and free of graRmatical* 
punctuation, and spelling errors. 



Students can be placed easily in the apptcpriate 
level ox the frogrw, 

AdeqijBtG record-keeping infoi'mation and n«terials 

are provided. 



Student has option to recei\;« directions on-scraan 
or proceed directly to assiqpad lesson. 



M&thDd of eriterinq i%n9^mrs is apprt3priat« to 
intended users, mcliiding use of back spring 
for erasure. 



Student cc ^trois pace of progrsn presentation. 



Student receives appropriata and effective 
feedback. 



REPRiriTED WITH PERMISSION OF RANDOM HOUSE, INC. C'TT v 



Studont interact* with the carfxiter in a. purposeful 

StucWit can exit the program before cciTpletir^ 
i tim les&cn^ if nacesMry. 

' Program loadB aasily and is tachnically sound, 

I Proorm branches to appropriate level of 
difficulty. 



I MBinu item are descriptive. 



j €cr6en displays are clg.\r, 

1 GrapW^cs arxl sound contribute to instructional 
quality, if they are used. 



Length of lessen is appropriate to student 
attention span. 

Packaging allows easy access and stare^qe of 
program* 



Scoring 

.Step I: Adi the scores for all the criteria 
to find the totitl score. 

Sicp i: Subtract the noriaer of ''Mot Appropriate" 

criteria from the total nuntjer of 

criteria (26), to find the nirtDer of 

criteria covered by the prograun. 

(26) - (**rtot Appropriate") - Criteria Covered 

SippJ: Dividte the total soore by the niiTt)er of 
criteria covered to find the final score 
for the programs, 

(Total Score) - Final Score 

{Criteria CovereSn" 

Si^^pl; Corpare the final score with the follcwing 
ratings: 

4 * QcOBllmt 

3 • Good 

2 ■ satisfactory 

1 - Unsatisfactory 



IN : rujK r i ••ms 
5 • Tar? t I ; 



. 'if :'foj« . 



i ' » V* 

- For .»f.-n .-1,!,... . . -^ufM'ly if I t o 1 nr f n»n r.-|.i.^nf.-.l ,^ r-l ink-< |hmv. if f«i^nnl.-f a... 



nvtRVtrw * o«scfib« th« pro^r«iii briefly tn t#rift« of (tt 9oal« 
•valuation hrr*>. 



an4 



to «ciit«¥« v\mm 



z^'^.trr. o/".^:i;i rai^.r^:;;:^?:; ^r^^r ^^^-^ - 



OOC^HtHTATlCtt - List iMtvrtal^ %ccw^«nyin^ ch« 



t. If>dlc«t» typ^« of xnfntmut inn includvd. 

J. F«rforM«ncft object w«a . 

a. Cor .^mnori «ith •Ciml^rd 

f. Fr#r»quiitt*i fisr jt« of Pro^r«», 

. opwrati^^ 1 na t rue t io<^a , 
I. Lttttn^ and ta«pli« run* of pTQqr^miti, 
). tf 4 •imul,%tion, '1«tcf»rtion of th« 

4i »roi • loni , 

1. Suo<34i rod f#f*r*.nc*^'Tc»'tvttl<"« for 

' ■ f c M - up . 

K Jf 4 **^r Kb/xik I* inctu'S«-t, the fofsut \n6 

JVSTWUCtrONS CTVEW lin .r^fn BY PHOCHAW 

The >ftitraetio«*l to r^rf<yrmm^, 

^. of »»ow to intt»r*cl with th# 

rroQri^ , 

i. Uf«r f.ht option of «ftJppM^ 
inftrgcttona if ilr*a<{y «nown , 

i , Output <1t<pUy*»'l tcf^^n hy ncrt^^n 

l'a#f fonffol 'iv»r rantinwin^ t*> th» 

h. Amojnt of tnf0f«4t;ofl in oach pt^o !• 

' oippropr L «t« . 

c, Tho ii*rr»rtu*l >«p*»:t <4JiKjunt of typ* 

» Oufput I* «M<:*d ^rtd f->ri«Jitl*J to «■ to 

- - ■ " rji i I y r#«d^b . 

4. r.anoua^a t« .#« U •uit^d to mntt nt\jKi^nt%' 

- - — r*ad in9 Ob i W ^ y . 



rjf«t corrvct 9r«wi«r ,a^l I in^, 

hypHrnatio" *nd pwrtct u«t t<Ki . 
i. Arty ^rid or coordirtut** syat*** usFd 

con«l«tpnt Mieh oo ^ o w convent Aont . 
7. Studrntt c*n r'-tpoiM wtth c o iwiow ayvfrolt k 

M4y« of w«if^9 tfM^, p,^,, rtqht to Uft 

«ntry of sunii. 
I. Accept* abbr«vi4tton« for conmh 

roscwnso«« 

Provtdts for individual fi*«Ja . o.f.. 
iHsportsidity to iMrH with Nafdor or OAalor 
iMtori*! . 

lO.OUlof i« 9«rson«l isv<1 , i.« , mmk^w 
■{»propriatv uto of student f%tm^m . 

U ,Umo d^vtcoa to k maintain intoroot« 

vari«c}on of coMptft#r raipouM* , 
^umor* pMcm cMnr#. turprtao, 

I2.Hakot good aao of any ip«cial features of 
computer f 

b. Color 

c . found 



n .«^tnforcirnj r*ifpofit-»* MnrfiC^^tjoni of 

rtghe . wfofig, "Pi*,) \ri* ipp ro^ir t /ite . 

J4,TN» nu«U"*r of nffonq .^naMem AMow^d ;f 

— ft^i^on/iblf< , 

U.»»«ponda ^|»t»fOpri*tf iy if ^Uonvd nu»b«r 

of wtfcjft^ in*v«r« i» '^Kc^^rd. 
]*,rfOvid#* o^'portkinit) to 9«t h#ip if 

— difficulty It tfirountpred . 
I'^.winimn^a b«d '^ntrt^t vte S^vic^9 such a* 

obj^ctiv* fofiMr* {Mlttpl# d^ice.itc). 
!l,D«eU with irtippropr let^ eivtrtea , 

i.w.f ref^ft«» to typm* trrQtt, rtc, 
11 int«U4SFl&l* g^^fui. 
ti.Se^uire^ -ntritft af't within •tudcnta' 

capabiUiiea {#ftp. typirtf, v«ca»wi«ryK 

iO.^efkOfti itudent p«rfof«4ac« p«riodiCai;y 
AM ac end of Msaion. 

\. U M ■(■wiation, t^ nrofroM fW«t a 

»«ff i<:ie«ily iL'Ctif«t«* r#pp»Mfitflt i*« of 

ch« 4ttk«acioft iii«u:^c>*f<. 
2. The C0AC«rtt iml (OTAtouiAry r«t«lr*d tm 
ui«> th*» j»ro*it lip AT'* rf«««iiiuitote. 
f^r<t«t pro^rly fr«« W 



J 



*, ft wvfU itriictyr*H ^^vd do cu e ^ ftte^ 

intern*ny to f^cilttite My nid«sury 
debuf^tnf /M^dlf icAttoft . 



.ou^!!. . V! ^'^ •il'li-.^onai «h.et* aa n-cMaefy to provide any ttMr iiif«r««t *mich 

^.c*to *hat ynu \>-M^t W <io«t %*H»at rr^f.^d^. AUo. Uti any cha r- . . 



any chan^f** rfifi<-n aNOuld M aad^ , } 
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Software Evaluationfdrm 



Kt view<r'f Name: 
^ndrrsft/ Phone: 



i'ro^r«m Tide. 



I\u'k*fic Title- 



MuTocamputer (brand, model, memory)- 
NrvtrtMry Hardware 

1 ' roducer 



l(.ivk-up Cupy Policy 



^ Date of Review:. 

J ) 



Medit&m: 5" disk; 8^ dink; 

cartridge: Upe 

Copyright Date iii any) 



. Neceuary Software- 

, Authoriil 

,Co«t 



PARTI 



ProffWfi Ov«rvtew Mid DMcr^ition 



Subject area vid specihc topic _ 
Prf rrquiiite slull$ necessary.- 



Approprutc grade ievd (circle) 12345678910 11 I2coU<;gc 
Type d program (check one or more ) 

— StmuiatJOf) Testing 

— E duca tionii G ame C Ussroom M arujicrnent 

— r>nll and Practice Other (specify ) 

Tutonai 

.- , Problem Solving ^ Remec-^tion 

Authoring System EmTchmem 

Ap^opnate fiioup instnictKyfuJ sue: . u'^vxiual small group ^cUss 

is :hiH proiirarn an appropnatr msinK tjorval use of the computer? 



Bncrty bst the prognrn's objectives. Are they detriy stated m the pf ognm or 
m liie dfKumemation? Are they educatjooaiiy vaKubie? Are they achieved? 



^ Hnefly descnbe the program. Memjon any speciii strengths w weaknesses. 
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Part 2 

EvakistkmCh^cktot 



hca»^ che^'k Ye*, No. or Not AppjK:«il>i« for each qi>c»lion bciow. To a<ld tfiiornwtKKi, cji U) 
cUnfy an ^ruiw^r. luc "Comments" end ol each ^ectuxi. 



Ym 



No 



N/A EDUCATIONAL CONTENT 

I. Is the prograin ^(Hilcnt act'uratc^ 

2, is the progrtin content i^^opnitc lor intended users' 

- 3. h the diihcuity level o)asi'^iem tor maienai. interest, iind viKabuUr>^ 
4. Is the progriim content free of racul. iwfxudl. t)f poiitKal bias^ 



Comments: 



Ym 



No 



HiA PRESENTATION 

I U the priigr^ tree ol technical prohiems'' 

2. Arc the tfi«tnKlx>ni cicar' 

3. is the cumcuiuin maieriAl iog^caiiy pretented and well organued " 

4. Do graphtci. iot^Kl aiKi cokx". tf u>ed, enhvKe the 

tnstrucUonai presentatfon^ 
^ Is the !rame dispiav ciear and caiy to reid/ 



Comments: 



No 



N/A 



INTERACTION 

1. Is the feedback elective and sppropnate'' 

2. ik) cues and prmnpts help students to answer ques»tH>ns correctly ' 

3. Can students access ihe pru^am "luenu" Un twip to change 
^•tj\ilies.' 

4. Can students control the > xc and 5ieq;«:ni'e of tt*r program^ 

5. .-Ue there safegiiards ajfainiii students "hwrnbmx the program 
by error»e<Hi» mputs.' 



CoiTiniems:- 



Yos 



No 



N/A TEACHER I S£ 

1 h record 'kce^^ig pof sibic (wuhm ihe prvjifram m through 

docurrwfniation worksheets)^ 

^ 2, Does teacher havr to monitor student uirc*^ 

3. C^n teacher modify the projjram:' 

4 Is the dow'umentalion clear and ctxnpreh^riSjve' 



j Comment*: 



PARTS 



OvmM EvabMtkNi 

CHECK ONE 

^.Exceiiem program. Ket'ocnmcnd wiihotit hesuauon. 

Pretty gfxxi program Con&ider purchase. 



_Fair. Hut niight wint to wnt for something txriter 
._No( useful. I>o not rec*ofT\n>eixl purt*haie 
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Where to Find Reviews of Courseware 



MAGAZINES 
Review Journals 
Courseware Report Card 

(Two editions: K-6 and 7-12) 150 West Carob Street, Compton, California 
90220. (213) 979-1955; (213) 637-2121 

$49.50 for 5 issues/year. Average number of reviews ^er issue: 20-25. 
In-depth description and evaluation, including capsule summary rating 
various aspects of the program from '^A** to "F." 

Dvorak^ Software Review 

704 Salano Avenue, Albany, California 94706. 

$5.00 for 8 issues/year. Average number of reviews per issue: 2-5. North 
Star software only. 

The Apple Journal of Courseware Review 

Apple Educational Foundation, 20525 Marian! Avenue, Cupertino, California 
95014. (408) 973-2105. 

$5.95 per issue; 2 issues/year. Average number of reviews per issue: 20. 
In depth critical evaluations with complete descriptions of each program 
and its potential for effective classroom use. Apple software only. 
Photographs of actual screens from each program. Available from 

microcomputer dealers. 

Pipeline 

Conduit, University of Iowa, Box 388, Iowa City, Iowa 52244, 
(319) 355-5789. 

$15 for 3 issues/year. Average number of reviews per issue: 8. Primarily 
college level but useful for advanced high school mathematics and science 
classes. 

School Microware Reviews 

Dresden Associates, Box 246, Dresden, Maine 04342. 

$40 for 2 issues/year. Offers rating scale 1-10. Apple, PET and TRS-80 
software only. 
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80 Software Critique 



P.O. Box 134, Waukegan, Illinois 60085. 

$24 for 4 issues/year. Offers rating scale 1-100. 

Other PeriodiGals 

Ai£DS Monitor 

1201 - 16th Street N.W., Washington, D.C. 20Q36. (?02) 822-7845. 
$15 for 4 issues/year. Average number of reviews per issue: 2. Article 
"Survey of Commercial Software" by Karen Jostad and Marge Dosel (October/ 
December 1980) surveys 1,225 software programs. 

Arithmetic Teacher 

National Council of Teachers of Mathematics, 190R Association Drive, 
Reston, Virginia 22901. (703) 620-9840. 

$36 for 9 issues/yea?. $30 membership dues include magazine subscription. 
Average reviews per issue: 5. Mathematics programs only. 

Classroom Computer News 

Box 266, Cambridge, Maine 02138. (617) 923-8595. 

$16 for 6 issues/year. Four to five fairly extensive reviews per issue. 
Currently expanding review coverage. 

The Computing Teacher 

Department of Computer and Information Science, University of Oregon, 
Eugene, Oregon 97403. 

$14.50 for 9 issues/year. Average number of reviews per issues: 8. Often 
includes reviews produced by Micro-SIFT. 

Creative Computing 

Box 789-M, Morristown, New Jersey 07690. (800) 031-8112; or in New Jersey 
(201) 540-0445. 

$24.97 for 12 issues/year. Average number of instructional software 
reviews per issue: 20. Short descriptions with some critical evaluation. 
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CUE Newsletter 



c/o Don McKell, Computer-Using Educators, P.O. Box 18547, San Jose. 
California 95158. 

$6 membership dues includes 6 issues/year. Average number of reviews per 
issue: 2-6. 

Educational Computt-r 

Box 535, Cupertino, California 95015. 

$15 for 6 issues/year. Average number of reviews per issue: 1. A 
thorough, critical evaluation. 

Educational Technolof;y 

140 Sylvan Avenue, Englewood Cliffs, New Jersey 07632. (201) 871-4007. 
$49 for 12 issues/year. Average number of reviews per issue: 6. In-depth 
evaluations, with detailed information on field-testing. 

Electronic Learning 

902 Sylvan Avenue, Englewood Cliffs, New Jersey 07632. 

$19 for 8 issues/year. Average reviews per issue: 4-6. Each one prepared 
by teams of curriculum specialists, teachers, administrators, and (where 
appropriate) students. 

EPIE Report 

HPIE Institute, Box 620, Stony Brook, New York 11790. 

$25 for 18 issues/year; $5 for associate subscriptions, reviews per issue: 
5-6. Mostly mathematicn in first issue. 

InfoWorld 

375 Cochituate Road, Box 88Q, Framingham, Maine 01701. 

$25 for 51 issues/year. Average number of instructional software reviews 

per isue: 5 (July-September only) 

MACUL Journal 

Michigan Association for Computer Users in Learning. Wayne County, ISD, 
33500 Van Born Road, Wayne, Mfchigan 48184. 

$5 membership dues include annual issue of reviews which contain 113 
reviews in 1980 and 143 in 1981. Plans for 1982 issue indefinite. 



Mathematics Tsacher 



National Council of Teachers of Mathematics, 1906 Association Drive 
Reston, Virginia 22091. (703) 620-9840. ' 
$36 for 9 issues/year. Average number of reviews per issue: varies. 
Brief descriptions with occasional critical comments; includes references 
to soft^vare reviews in other journals. 

Microcomputers in EdiJcation 

Queue, 5 Chapel Hill Drive, Fairfield, Connecticut 06432. 
$24 for 12 issues/year. Average number of reviews per issue: varies. 
Brief descriptions with occasional critical comments; includes references 
to software reviews in other journals. 

Micro-Scope 

Jem Research Discovery Park, University of Victoria, Rox 1700, Victoria 
B.C. V8W 2Y2, Canada. (604* 477-7246. 

$10 for 12 issues/year. Average number of reviews per issue: 3-6. 
Peelings II 

P.O. Box 188, Las Cruces, New Mexico 88001. (505) 526-8364. 

$15 for 6 issues/year. Average number of instructional software reviews 

per issue: 1-2. 

Personal Computing 

P.O. Box 2941, Boulder, Colorado 80321. 

$18 for 12 issues/year. Average number of instructional software reviews 
per issue: 1-2. 

Software Review 

Microform Review, 520 Riverside Avenue, Westport, Connecticut 06880 
(203) 226-6967. 

$38 for 2 issues/year; in 1983, $50 for 4 issues/year. Average review i per 
issue: 2-6. Very detailed (6-10 pages long); with illustrations. 

T.H.E. Journal 

Technical Horizons in Education, P.O. Box 992, Acton, MA 01720 
(617) 263-3607. 

$15 for 12 issues/year; free for qualifying educators, administrators or 
department heads). Listings of newly-leased software. 
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TRS-80 Users Journal 



P.O. Box 7112, Tacoma, Washington 98407. (206) 759-9642. 
$16 for 6 issues/year. TRS-80 software only. 

80 Microcomputing 

P.O. Box 981, Farmingdale, New York 11737. 

$18 for 12 issues/year. Average number of instructional software reviews 
per issue: 5. TRS-80 software only. 
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i^bon^ f 11 1 teaourcM in Coaputtr Mucatioo XXljOoBlrT 
300 S. w. Sixth Awnuc, Portland, Ors^caci 97204 CSC3} 24S-68C0 



What is RIC£ 7 

MCE, .:«iourct» in Coaputtr Education, i* mn inforMtion b4tt dttignad to 
provide ittforMCion about thm ttatt of tbt «t,c in thiu*Prlic«tion of 
coopuctn ia ichooii- It it « datsbaat-rlmatAltta-il Tha coaputtr of 
Bibliographic Xatriaval Strvicta, Inc. (BXS) io*Uthm«, «m York. It wa» 
datitT^«d by th« staff of th« Northwct Regional £ducaCioa«l Laboratory, 
with aupport froo tht XatiooAl Instituta of Sdxication. 

Ac prctant, two catagoritt of inforutibn cc^rit« tb« datmbaaa: 

o Produrart, which includas comarcial and noncoMsrcial producers 
of co«putar-baiad inicructional and adainiatrAtiva toftvara 

o Softwar* Packagai^ which contaitu daicriptiva :*ad avaiuativa 
inforution about knom products froa productrt 

Daacripciva infor»ation it baiag ant«rad on «iX known aoftifara product* 
for education. Evaluation data it antarad on thota producta for which it 
it ayailabla. Covplcta data frow MicroSITT avaluation« im iccludad, and 
bibliographic rtfarencaa ara cicad for othtr aourcst of «w«Xuaciva data* 

Additional catagoriaa of infonution will ba ^ddmd to RICX during 198S. 
Producar and Softwara catagoriaa will also ba updatad and anlargad on a 
ragular baaia aa naw ioforsation ia availabla. 

How doaa ona laia accaaa to RICE ? 

It is anticipatad that moat of tht diract accaaa to RICE will ba bT 
organixations auch as intaraadiata aducation uaita and atata adiication 
agancias which provida saarch larvicas to thair conatituant districts or 
schools. Any library or othar cantar that providas ERIC aaarch sarvicaa 
using the BRS systa& could alao accaaa RICE if thay wish. 

To conduct ktarchaa, thraa thinga ara rtquirad: (1) th« agancy lauat ba 
A iubicribar to BRS, Inc.; (2) th* agancy auat hava cofltput^r tanainal 
cc^uipaent; (3) tha agancy will naad a ataff natabar trained or axpariancad 
In aaarching drntBh^MmM. 

I. Sabacription . If not already a aubacribar, tha aaaieat Mtbod is for 
the egency to join the School Practices Information lUitvork (SPIN). 
Ihfire ta a one-tiaa coat of $150 to join SPIl^* AppIicAtion* can be 
obtained from BRS, Inc., 1200 Route 7, UthaM, New York 12110, 
(518) 783-1161 or from local repreaantativas of Scott, Forea«aa and 
Cot&pany . 



acc«rpt«d fro« SRS N*vsl«tt«r, vol. 6, Ito. 9, S«pt*mb«r, 1982 

QSIHH YOUR KICROCONPUTSK AS A TEKKINAL 

Virtually «ny aicroco«put«r can b# us«d as a coMunicating data t»r»inal, 
thus pcrslttizig accast to &K5 without tha purchasa of a aaparata 
tarwinai* Accasaoriaa nacasaary to convart Klcros to tarainals va^ fro* 
coKputar to coaiputar, OHuaUy a taXaphona aodas (*oduiator/da»odulator) , 
a coaaunloationa Intarfaca or card, and a tarminal aiwiator softwara 
packa9a ara naadad. 7&a foUovin^ tachnical caqulrsMnta aust ba vmt 
whan coof iguring a «lcroco«putar to intarfaca with aHS< 



o naud Rsta 

o Parity 

o iXiplax 

o Data Langth 



-300 or 1200 baud 
•-Off or Saro (Qj 

-at.if or nil! 

-7 data bits « 1 stop bit 



A f av of tha. popular, aicrocoaputsrii and-acoassoriaa naadad to accass BRS 
ara ir^tad balovt 

HxcMozommzR sQaxPMzn rsqdirosents to iktsr/acx kits b&s 



HXCTOODHPOTIR 
APPLS IX 

APPU II ?LVS 
ATJUZ 400/800 

ISM PnSOMJU CONFOTSR 



IKSiTRlMSNTS 99/4 < 

99/4A 

n<S-eo Madal X 



TRS-80 Modal XI 
TRS-«0 Msdal III 



MDat C7/H-baaad 
aiorooonputars 



XKfiSSAXr 

aAiu:tcA«/sorrwAR£ 

TalaphoM aodas and coawunicationa card, or 
Hayas Nicrowdaa IX, and tarminal aoftwara. 

M^as, coMunicationa card and ^aniinal 
aoftiiara* 

ATARI 850 Intarfaca sodula, aixiaJi, snti 
aoftiraca. 

XS£S intarfaca, aodaa, and tarminal softwsra. 

Msdaa, e n— o nicatlosa «d«ptar# and optional 
tarainal aoftvara. 

RS-232 intarfaca, aodaa, and taminal 

^^$ULATOK IX soZtwaxQ cartridga* 

RS^232 intarfaca raoard, axpansion intarfaca , 
aodaa, anci RS Tirns aoftwara OR spacial RS 
925-^1172) wda« and «oftwara« 

Modaa and RS-2?2 cabla* Software optional. 

RS~232 intarfacs board, sodas, and RS Tara 
aof twars. 

»lapbona aodan ^d:^L^232 port. 



VChan configuring a «icrocoa»potar as a tarainal,;a consultation with tha 
hardwara/softwara daalar is ispcrativa. ftRS Qistoaar Sarvica offars 
asaistancs ss wail. Pl«aaa hava til hardwaxa/and tantinal aoftwara 
doci:»antation raadiljjr availabla whan calling to fa-rilitata answars and 
avoid. trial and arrorl 
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